home *** CD-ROM | disk | FTP | other *** search
/ MacWorld 1998 June / Macworld (1998-06).dmg / Shareware World / Comms & Internet / NetPresenz 4.1 / Showcase / tricky / robots / robots.txt < prev   
Text File  |  1996-01-30  |  224b  |  10 lines
  1. # robots.txt file
  2. # 
  3. # purpose to World Wide Web Robots trawling your web site (or parts thereof)
  4. # 
  5. # For more info consult:
  6. #   http://info.webcrawler.com/mak/projects/robots/norobots.html
  7.  
  8. User-agent: *
  9. Disallow: /local/
  10.